Journal of Technology and Science Education 


iLtorse 


TECHNOLOGICAL OR TRADITIONAL TOOLS FOR DOCUMENTS' CORRECTION? A CASE STUDY 

IN HIGHER EDUCATION 


Zein Kallas, Cesar Ornat 

Escola Superior d'Agricultura (Universitat Politecnica de Catalunya, BarcelonaTech) 

Spain 

zein.kallas(a)UDC.edu, cesor.omot(a)uDc.edu 


Received July 2012 
Accepted September 2012 


Abstract 

Information and Communication Technology is playing an important role in assisting teachers in their activities. 
They became a) more efficient, b) more precise and c) more comprehensive. The "Audio" ad is a clear 
illustration for this trend. Students' acceptance of the "Audio" tool has been analysed and compared with the 
"traditional" correction and the "track change". 57 students have answered a structured questionnaire using a 
web 2.0 application for creating an online form. Results show a high relative importance for the "Audio" 
correction (42.02% of), followed by the "track change" and the "traditional printed document" with 33.02% and 
24.95% respectively. 


Keywords - Information and Communication Technology (ICT), Audio correction tool, Analytical Hierarchy 
Process (AHP). 


1 INTRODUCTION 

Information and Communication Technology (ICT) is changing modes of learning, collaboration and expression 
(Atkins, 2005). It has allowed enhancing and transforming information to be better assimilated. Most of 
teachers remain unaware of the high number of these non-traditional learning opportunities or are hesitant to 
use them (Bonk, 2009). These tools may play a significant role in helping teachers to improve the development 
of their subjects in an efficient and precise way (Lever-Duffy & McDonald, 2009). In this context, a rethinking of 
the use of communication technology in education by teachers is needed as a mean of a continuous adaptation 
to students' preferences and a constant improvement of the transmitted information for learners (Raschke, 
2003). Spector (2001) mentioned the potential allowed by these technologies for education. However they still 
requiring a higher acceptance. This study may represent for skeptical towards the use of technology in 
classrooms an indication that the student preferences are changing. 

Among the ICT options, the Web 2.0 tools had arisen as great supporting elements in developing educational 
activities, helping learners and involving students continuously in different tasks (Bonk, 2009). Den Exter, Rowe, 
Boyd and Lloyd (2012) mentioned the need to develop, support and encourage strong interaction both between 
teachers and students, and amongst the students themselves using the Web 2.0 tools. These tools emerged as 
useful utilities in educational technology (Churchill, 2009) and became ubiquitous with sharing and 
collaboration features (Grosseck, 2009). The ability of teacher to interact correctly with the students is one of 
the most determinants factors of success in his classroom (Mercer, Littleton & Wegerif, 2009). In particular the 
on-line communication is recently receiving higher attention (Moller & Huett, 2012) due to its capacity to 
facilitate deeper and more satisfying personal connections between learners and professors. 

From the different resources on the web, different tools are being released constantly, each with its specific 
utility, advantages and disadvantages (for an interesting classification of these tools, you can consult among 



Journal of Technology and Science Education. Vol 2(2), 2012, pp 86 

SN 2013-6374 -Print-ISSN 2014-5349 DL: B-2000-2012 - http://dx.doi.org/10.3926/jotse.48 








Jourrnal of Technology and Science Education - http://dx.doi.org/10.3926/jotse.48 


other Churchill, 2009). Among them we highlights the collaborative presentation tools (Mindomo for mental 
maps, Prezi as alternative to PowerPoint, etc.), for collaboration (Google applications such as documents, 
recently changed to Google drive, calendar, and sites, etc.), for storage and sharing (Dropbox, sugarsync and 
syncplycity, etc.) and for collaboration (Blogs, twitter, Wikipedia, etc.). From the different utilities provided by 
the web 2.0 technology, the "Voxopop" tool is an interesting option due to its potential to be used as a voice 
based e-learning approach. It relies on message boards but using voice rather than text. The obtained recorded 
voices files can be shared between individuals in three ways: public, semi-private (do not need an account) and 
private (need a Voxopop account). However, this application suffers from the restriction of including the 
obtained audio files in other software such as the text processors which may limit its use to just a way of 
communication between teachers and students. 

The idea behind this work is to use the teacher recorded voice in the task of correcting documents. We consider 
that this may allow a better explanation of knowledge by including it directly within the students' documents, 
allowing a large and better flow of information in a short time (i.e. by talking the number of words that can be 
transmitted in a minute is much larger in comparison to writing them). This fact may increase the teacher 
efficiency in using time and efforts. In this line, a text processor is needed that allow inserting voice within the 
document. To our knowledge, there are no web 2.0 tools that may facilitate this requirement. For instance, the 
Google drive tool does not allow (up to date) introducing voice within its text processor. However, both the free 
soft wares (OpenOffice) as well the licensed one (Microsoft-word office software) allow inserting and recording 
audio file within the text of a document. The main objective of this paper is to analyse students' acceptance for 
the "audio/voice correction" tools in evaluating their works by introducing the teachers' voice within the text. 
We seek also to compare this correction tool with the "traditional" correction method of printed document as 
well with the "track change" tool of any text processor. We used the office word text processor as it is the usual 
used software in our university and for students. 

2 METHODOLOGY AND EMPIRICAL APPLICATION 

To analyze the students' acceptance of a new correction tool, two specific objectives have been identified. The 
first one focus on analyzing the "relative importance" of the "voice tool" compared to the "traditional 
correction" one (writing on printed document) and to the "track change tool" of a text processor. The second 
objective tries to analyze factors affecting the perception of difficulties that students could face when using it. 
To reach these objectives different techniques have been proposed. Table 1 summarizes the applied methods. 


Technique applied 

Objectives 

The Analytical Hierarchy Process 

Relative importance of correction tools according to student's opinion 

The Logistic regression 

Factors affecting difficulty faced in using the voice correction tools 


Table 1. The Methodological framework 


The data used in this analysis was obtained from a survey using a structured questionnaire with students. We 
used the Google Form option to ensure students anonymity allowing them to comment freely their opinions 
and concerns. The questionnaires were carried out during April 2011. The questionnaire solicits information on 
student's characteristics (age, gender) and their opinion toward the different correction tools and their 
attitudes in using laptops and smartphones. Almost all the questions were designed as open-ended ones, 
allowing a better quantitative analysis. However, we keep some open questions related the advantages and 
drawbacks of the audio correction. The final sample was about 57 students of agro-food marketing subject in 
their second year of the agricultural engineering grade. The questionnaire used can be found at: 

http://bit.lv/UoHJsv 

It is worth mentioning that before carrying out the survey, students have already experiment the voice 
correction tools as it was used to correct some document in a work group's task. This deliverable was dealing 
with a synthesis of a market analysis of an agro-food product. To insert a voice comment, the process starts by 
inserting an object (from the insert menu) and continue by selecting the option of voice file. In a subsequent 
step, we choose the "new file" option and we start to record our voice comment within the document for one 
minute as limiting time for each inserted audio file. Later the document was sent to student in order to hear the 
corrections and comments. Follows we explain very briefly the use of each technique in this study. 
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2.1 The Analytical Hierarchy Process-AHP 

The AHP is a mathematical technique for multi-criteria decision-supporting method in discrete environments 
(Saaty, 1980). It enables decision makers in their planning, setting priorities, selecting the best product among a 
set of them, and allocating resources. It aims to decompose a complex decision problem in a hierarchy of 
smaller constituent sub-problems. Thus, determining the individually most preferred alternative from a set of 
elements is a decision problem where the hierarchy top level represents the individual elements (Figure 1). 


Concept 

r- I 

Element l(Ei) 


Element n (E n ) 


Figure 1. Hierarchy of elements 


In order to implement the AHP, alternatives should be compared in order to set the best and preferred one. 
Thus, one needs to carry out a survey where individuals are asked to make a pairwise comparison between 
elements. First, the respondent has to indicate which of the two elements the respondent prefers. Then a nine 
point scale is used to measure the strength of this preference by means of verbal judgments as can be seen in 
Table 2. 


Importance rates 

Definition of the scale 

1 

Two characteristics are equally important 

2 

Between 1 and 3 

3 

The preferred characteristics are slightly more important 

4 

Between 3 and 5 

5 

The preferred characteristics are moderately more important 

6 

Between 5 and 7 

7 

The preferred characteristics are strongly more important 

8 

Between 7 and 9 

9 

The preferred characteristics are absolutely more important 


Table 2. The AHP comparison scale 


As mentioned before, a pair wise comparison exercise is needed in order to obtain judgments that estimate the 
relative importance for each alternative at individual level (students) as well at the whole sample. An example 
of a pair wise comparison used in our questionnaire can be shown in Table 3. 


The "voice correction" tools 

The "traditional" correction of printed document 

9 8 7 6 5 4 3 2 

1 

2 3 4 5 6 7 8 9 

The "voice correction" tools 


Track change tool of text processor 

9 8 7 6 5 4 3 2 

1 

2 3 4 5 6 7 8 9 

The "traditional" correction of printed document 

Track change tool of text processor 

9 8 7 6 5 4 3 2 

1 

2 3 4 5 6 7 8 9 


In your opinion, which correction tool do you prefer? Indicate the degree of superiority of the 
preferred element. In case of equality of tools, select the option "1". 

Table 3. Example of the AHP questions 


From the answers provided, a matrix is generated for each student k and is known as the Saaty matrix: 
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Where represents the value obtained from the pairwise comparison between element / (ie N / ie P) and 

element j; (je N / je P) for each student k. The fundamental properties of this comparison matrix are: a) 
reciprocal comparison: if a^=x then a j jk =l/x); b) homogeneity: if characteristics / and j are judged to be of equal 

relative importance then, = o. jk - 1; and c) all the elements of its main diagonal take a value of one 

Kir 1 v ')• 

If perfect consistency in preferences holds for each student, it should also hold that a jhk xo^ = for all /, j 

and h (he N / he P). This condition implies that values given for pairwise comparisons represent weights given to 
each element (correction alternatives) by a perfectly rational student 0 ^= w jk /Wj k for all / and j. Therefore, the 

Saaty matrix can also be expressed as follows: 
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Under such circumstances, K weights (w Nk ) for each alternative (N) can be easily determined from the N(N-l)/2 
values for a^. However, perfect consistency is seldom present in reality, where subjectivity plays an important 
role in the pairwise comparison. Thus in the case of perfect consistency it should hold that: S^xW=NxW (for 
alternatives) where W =(w r w 2 , ..., w N ). However, in Saaty matrixes (S k =o } . k ) some degree of inconsistency is 
present. Therefore, Saaty proposed the redefinition: 

5, xW= X xW, where X is the maximum eigenvalue of matrix S, which is determined by: 

k max max k 

Ana* = (3) 


AHP was originally conceived for individual decision-making, but was rapidly extended as a valid technique for 
the analysis of group decisions. Thus, we aggregate corresponding individual weights (w jk ) across students to 

obtain a synthesis of weights for each correction alternatives ( w .). The geometric mean can be used in the 
aggregation process for the whole sample as follows: 


w. 



VI 


( 4 ) 


2.2 The Logistic Regression 

Logit models are a basic tool for analyzing problems with a binary variable (yes / no, agree/disagree, like/dislike 
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treatments. The acceptance (1) or not (0) of the students of the voice correction tool fits perfectly in the same 
regression model. For this reason the logistic model has been considered in this paper to analyse this response 
variable (Y). The purpose of the logistic regression is to obtain a multiple relationship between different 
variables with the following characteristics: 

• The response variable (Y) is discrete, usually formed of a true (1) or false (0) values. 

• The explanatory variables are the personal characteristics. 

• The starting model is not linear but exponential, but with the logit transformation is represented as 
linear. 

The Logistic regression tries to express the probability pi to accept the "voice correction" tool in front of not 
accepting it (1-Pi) according to the following exponential model: 

hl ( ttj) =Po+P,x Il +p 2 -x 2i +...+p k -x u (5) 


This model analyse the probability of occurrence of a success in the response variable (Y = 1, i.e. the acceptance 
of the voice tools) as a linear function of the explanatory variables (student characteristics; X ki ). To interpret the 
relationship between variables, the odds ratio is calculated ( OR/=e^) which expresses the change that originates 
in the probability a unit change in the considered explanatory variable, i.e. increasing or decreasing the 
probability of accepting the new voice correction tools. For more detailed information on the logit regression 
technique, the interested reader can consult Hosmer and Lemershow (1992) among other authors. 

For the application of the logistic regression, the dependent variable (y) used was the technical difficulty that 
faced student in using the "voice correction" tool. This variable was initially created using an 11 point scale 
(from 0 to 10) where 0 "did not face any technical difficulty" and 10 "I face several technical difficulties". In 
order to adapt this scale for a logistic regression, we have created a new variable that take the value of "0" if for 
the scale value is from 0 to 5 (26.3% of the responses) and take the value of "1" if the scale value is from 6 to 10 
(73.7% of the responses). The explanatory variables proposed for the realization of the logistic model were: 

• IDEA: What did you think of the idea of the correction voice option? 

• GEND: Gender of the student 

• LAP: Do you have a laptop? 

• PC: Do you have a desktop computer? 

• SMRT: Do you have a smartphone or similar with Internet connection? 

• AVRG: What is the average grade you usually get in a course? 


The final constructed relationship is: 


ln | yh + fr-IDEA, +p 2 GEND i + p, ■ LAP i+ p< ■ PC , +fi s -SMRT t +p 6 -AVRG i (6) 


3 RESULTS 

Results demonstrate that the idea of the "voice correction" has been positively perceived by students with an 
average valuation of (8.58) on a scale from 0 to 10 points. However, students stated that they faced some 
technical difficulty in hearing the corrections (7.04). This is because some of the desktop computers in the 
University (for students) do not contain "sound card hardware" and therefore it was difficult for students to 
realise this task in the University. In addition, using their personal computer was also in some cases difficult. 
They state that they do not usually use earphones and thus hearing the correction in a public space is 
restrictive. In this context students were asked to mention 3 main advantages and three main disadvantages of 
the "voice correction". Results are summarized in the Table 4. 
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Disadvantages 


• You cannot get a piece of the recording, but 
you have to hear all of it. 

• Obligation to have headphones or speakers. 

• If you're in a public place and do not have 
headphones, you can annoy other people. 

• File Size become huge with many voice 
corrections 

• Problems in compatibility of versions for the 
text processor. 


Advantages 

• The corrections are clearer. 

• It is a quick and easy way to understand what 
should be corrected. 

• You can edit the document while listening to 
the voice. 

• It is fast , clear and concise. 

• It is a useful and innovative method. 

• You do not need to print the corrections. 

• You have always the corrections for the future 
(low probability to lose a file than a paper). 

• It is a more ecological method (less use of 
papers and ink) 

• Allows the teacher to better express his ideas. 

• It is closer to student. It's more like a face to 
face correction. 

• Allow for much information in little time. _ 


Table 4. Advantages and disadvantages of "voice correction" as stated by students 


For the AHP, results allow us to identify the relative importance of the three analyzed alternatives of 
corrections. Figure 2 shows a graphical illustration of the obtained weights. As can be seen, the proposed 'Voice 
correction" tool was the most preferred one by students with an average weight of 42.02% compared to the 
other alternatives (24.95% for the traditional correction and 33.023% for the track change). This result sows 
high acceptance toward the voice correction method as a new tool adapted to student's concerns. They stated 
that they prefer correction method that allows them to feel closer to teacher and to obtain concise and better 
information in correction within a few part of time. 



^ - *1 

Alternatives Correction Tools 
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Voice correction tool 
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(AO 

(iv, = 24.95%) 

V J 


f -\ 

Track change tool of text 
processor 

(AO 

(w 3 = 33.02%) 

V J 


Figure 2. The relative importance of alternatives tools of corrections to be valuated 


In analyzing the factors that affect technical difficulties faced by students when using the voice correction, 
significant relationships are shown in Table 5. 


Variable codes 

coefficients 

Wald 

p of Wald 

OR,=e pi 

GEND 

1.368 

3.875 

.076 

3.927 

SMRT 

1.296 

3.320 

.068 

3.655 

AVRG 

-1.242 

3.785 

.052 

0.289 

Global predicted percentage =76.4% 


GEND: Gender of the student = 0 for female and 1 for male. SMRT: Fiave you a Smartphone or 
similar with Internet connection; 0 = No, 1 = Yes. AVRG: The average gotten in the courses. 


Table 5. The logistic regression model 


As can be seen, the model was significant for gender (GEND), having or not a smart phone with internet 
connection (SMRT) and the average grades of the course (AVRG). The relationship of these variables is 
significant (p of Wald less than 0.1), which indicate that these relationships are statistically different from zero 
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and justify a significant contribution of facing technical difficulties. 

Results show an OR = 3.927 for the gender variable (GEND) showing that the probability that male students face 
technical difficulties increase in front of females by 3.927 times. In this same line, student with smartphone 
with internet connection (SMRT) are more likely to face problems in using the voice correction than the other 
students by 3.655 times. This result seems to be unexpected as it is known that more "technological" students 
are used to face to face less technical difficulties. However it seem that the smartphone is becoming more 
associated with lifestyle and individual images than behaviour toward technology. Finally, for the average 
variable (AVRG) the OR is 0.289. We can state that for a 1 point increase of the students' grade, the probability 
that the student face technical problem in using the voice correction decreases 0.289 times. Thus, results show 
that more successful students are prone to accept this new form of introducing voice correction. 

4 CONCLUSIONS 

This paper focuses on assessing and comparing student's preferences among different alternatives of correction 
tools for documents. On the basis of a nine-point scale pair wise comparison, we obtained the relative 
importance (weights) of the analysed alternatives. Moreover, we use the logit regression model to analyse 
factors affecting technical difficulty in using the voice correction. Data was collected from 57 students of agro¬ 
food market subject in their second year of the agricultural engineering grade during April 2011. 

Results have shown a relative acceptance of the voice correction method. It seems to be an efficient way of 
work taking into consideration the quantity and quality of the information transmitted to students in few 
minutes in comparison to writing or typing corrections. However, improvement of such procedure is needed by 
allowing the edition and time control of the created audio file. This is because the system force student to hear 
entirely the audio file even if they need to hear only the last part of the voice comment. It seems to be essential 
that the computers in the education centre to be compatible with playing voice and at least with earphones. 
The voice correction tools support the need of such investment in the computers laboratories in the ESAB 
(Escola Superior d'Agricultura, Universitat Politecnica de Catalunya, BarcelonaTech) school where the study 
have been done. Finally, our results also make an insight for the decision makers of the educational program to 
integrate technological tools in the evaluation process of the students as an essential part to make the 
correction more efficient and more pleasant. 

Our analysis is based on a small sample in a specific university case study. Therefore, results should thus be 
interpreted carefully. In this context, more empirical application should be carried out allowing us to set 
definitive conclusions on the acceptance of this correction method. In addition, it is also highly relevant for 
future research to introduce the smartphone as a tool to hearing the teacher comment and correction from 
documents attached to the Moodle-mobile platform. 
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